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An associative memory model and a neural network model with a Mexican-hat type in- 
teraction are the two most typical attractor networks used in the artificial neural network 
models. The associative memory model has discretely distributed fixed-point attractors, and 
achieves a discrete information representation. On the other hand, a neural network model 
with a Mexican-hat type interaction uses a line attractor to achieves a continuous informa- 
tion representation, which can be seen in the working memory in the prefrontal cortex and 
columnar activity in the visual cortex. In the present study, we propose a neural network 
model that achieves discrete and continuous information representation. We use a statistical- 
mechanical analysis to find that a localized retrieval phase exists in the proposed model, 
where the memory pattern is retrieved in the localized subpopulation of the network. In the 
localized retrieval phase, the discrete and continuous information representation is achieved 
by using the orthogonality of the memory patterns and the neutral stability of fixed points 
along the positions of the localized retrieval. The obtained phase diagram suggests that the 
antiferromagnetic interaction and the external field are important for generating the localized 
retrieval phase. 

KEYWORDS: Mexican-hat type interaction, Associative memory model, Localized activity. Sta- 
tistical mechanics 

1. Introduction 

An associative memory model and a neural network model with a Mexican-hat type inter- 
action are the two most typical attractor networks used in artificial neural network models. 
The associative memory model represented by the Hopfield model has discretely distributed 
fixed-point attractors.^-* On the other hand, the model with a Mexican-hat type interaction, 
modeled after the hyper-column of the primary visual cortex and the frontal cortex during the 
memory-guided saccade, has continuously distributed fixed-point attractors (what is termed 
a line attractor) that reflect the distant relationship between inputs. ^"^^ 

Recent electrophysiological studies suggest that neurons represent informations as sparse 
and local neuronal excitations in the inferior temporal cortex (IT),^' ''^ specifically, neurons in 
IT area achieve a discrete and continuous information representation by using both positions of 
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a local excitation and microscopic firing patterns of a sparse activity in the local excitation. For 
instance, neurons measure angles of a visual stimulus with the positions of a local excitation, 
and consequently the corresponding information representation (firing pattern) continuously 
changes when the visual stimulus is rotated.^) Meanwhile, neurons discriminate visual stimuli 
by differences between microscopic firing patterns of a sparse activity, and consequently the 
information representation discretely changes when the visual stimulus is replaced/) Based 
on these evidence, Wada et al.^^ proposed a self-organizing map (SOM) model of IT area, 
and confirmed by numerical experiment that the sparse and local neuronal excitation is self- 
organized in their model. Additionally, Hamaguchi et al.^'^^ proposed an Ising spin neural 
network model with a disordered Mexican-hat type interaction, and verified that the sparse 
and local neuronal excitation is achieved in their model. However, these models do not store 
more than one pattern. In addition, Ichiki et al.^^ analyzed a model with spatially modulated 
Hebbian interactions. Equilibria of their model are transformed into those of the model with 
the Mexican-hat type interaction'^'^) by a gauge transformation based on a stored pattern. 

In this study, we propose a solvable neural network model, that achieves the discrete and 
continuous information representation. Our model is based on a Hebbian interaction weighted 
by a Mexican-hat type interaction.^) We use a statistical-mechanical analysis to show that 
a localized retrieval (LR) phase exists in the proposed model, where a localized part of the 
stored pattern is retrieved. The LR states are discretely and continuously distributed in the 
network state space, that is, our model has discretely distributed line attractors. Thus, the 
LR states correspond to the discrete and continuous information representation. Additionally, 
we use a stability analysis and a phase diagram to we find that the stability of the LR states 
depends on the number of the stored patterns, and that an antifcrromagnctic interaction and 
a negative external magnetic field are essential for stabilizing the LR states. 

2. Model 



We analyze an Ising spin neural network model with a microscopic state defined by the 
A?^-neuron state vector S = {So^jSq^, • • • , Soj^) G {—1, 1}^. Here S0^ = 1 if neuron i fires, and 
Sg^ = — 1 if it is at rest. Neuron i is located at angle = ^ — tt on a one-dimensional ring 
indexed by 6i G (— tt, tt], as shown in Fig. 1(a). The Hamiltonian of the system we are going 
to study is 

H{S) = E Jo.e.Sg^Sg^ -hY^Se^, (1) 

where h is an external magnetic field (representing a common external input to neurons). The 
interaction JQ^Q. (representing the synaptic interaction between the ith. neuron and the _7th 
neuron) consists of a Hebbian interaction weighted by a Mexican-hat type interaction, and 
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Fig. 1. Schematic of our model, (a) Geometry of neurons. The A^- neurons are circularly distributed 
at regular intervals, (b) Schematic of one part of intcrncuronal interaction Jo (1 + ^ cos{9i — 

Oj))^g.£,0, (the first part of the right side of Eq. (2)) as a function of neuronal interval 6i — 9j. This 
part represents a Hebbian interaction weighted by a Mexican-hat type interaction. Jq represents 
the strength of the Hebbian interaction, and k represents the strength of the weighting by the 
Mexican-hat type interaction. 



the antiferromagnetic interaction: 

J^^o, = I E(i + ^ cos(e. - - 1, (2) 

where Jq represents the strength of the Hebbian interaction, k represents the strength of 
the weighting by the Mexican-hat type interaction, and g represents the strength of the 
antiferromagnetic interaction. denotes the ith component of the stored pattern vector G 
{— 1, 1}^, and is a quenched independent random variable taking 1 or —1 with a probability 
^. p is the number of stored patterns. We restrict ourselves to a case where p is finite in the 
thermodynamic limit N ^ oo {p = 0(1)) throughout this paper. The Hopfield model in our 
model^-* is one where k = g = h = 0. The model with the Mexican-hat type interaction in our 
model^'^'^-* is one where k ^ oo with Jq/c remaining finite, g = 0, p = 1, and ^g, = 1(1 < Vi < 
N). Thus, our model includes the Hopfield model and the model with the Mexican-hat type 
interaction as special cases. In addition, the case where Jq < 0, < and g = h = in our 
model has been previously studied. ^-^ The antiferromagnetic interaction g and the external 
magnetic field h play significant roles in generating the localized retrieval phase, where a 
localized part of a stored pattern is retrieved, as described later. 

3. Statistical-Mechanical Analysis 

3.1 Free Energy and Hessian Matrix 

In this section, we calculate the free energy per neuron and the Hessian matrix. We define 
the following order parameters as: 

i 
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(4) 

(5) 

(6) 



vtIq is the overlap between the spin configuration and the stored pattern, and rric and mg 
are the order parameters that are the first Fourier coefficients of {Sei^Q.}f=\, regarded as a 
function of 6. Additionally we introduce another two order parameters for later use: 



m''^{S) = ^m^(S)2 + m^iSf, (7) 

^{S) = arctan(m^(S')/m^(Sr)), (8) 

where m^* and 4>'^ are the amplitude and phase of the first Fourier component of {Sg.^g.}^^, 
respectively. The Hamiltonian Eq. (1) is represented by these order parameters as: 

H{m{S), {m^{S)}, {m^{S)}) 

p 



9 



(9) 



(10) 



The partition function Z = Tre is represented by the delta function as: 

/oo roo P 

■■■ dm JJ dm(^dm^dm^ 
-oo J —oo 

— ^ 

p 

5{m - m{S)) W 5{m'^ - m^(5))5(m^ - m^(Sf))(5(m^ - m^(5)) 

exp(-/3i?(m, {m^}, {m^}, {m^)) ■ 
We can rewrite Eq. (10) by the Fourier integral representation of the delta function 
5{m' — m! {S)) = — j dm' exTp{iNrh'{rn' — m^S))), 

substituting m, m^, m^, and for m', and j^Y,iSei, j^Y,iSdAe^^ ;^ I]j 
F I^j '^ex^e'i "i'(S'), respectively; 

p p 



(11) 



/oo /-oo J" J" 

■ ■ • / dm dmodm^dm^dm drngdm^dm^ 



exp 



-PH{m, {m^}, {m^}, {m^}) + iN ^{rfi'^m'^ + m^m^ + m^m^) + 



mm 



(12) 



AT 



E '^^i IE + COS 6*^ + m^ sin 6'^) + m 



i=l 
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Taking the trace of Eq. (12), we get 

p 



/oo poo f f 

■■■ dm JJ dm^dm'^dm^dm JJ dm^drh'^dm^ 



exp 



-PH{m,{m^},{m^},{mn) 



N 



+iN ^ {rh^mi^ + rh'^rn!^ + ■m^m^) + -rhm + ^ log 2 cosh Ph{ei) 
.n=i 



i=l 



where h{6i) is a local magnetic field defined as 



(13) 



h{ei) = I ^ (m^ + cos + sin 6lj)+m I . 



(14) 



We can evaluate these integrals by using the steepest descent in the thermodynamic limit 
iV ^ oo. 



Z = exp(-7V/3/), 
where / is the free energy per neuron given as 

/ = - Y E { K)' + k {{m^f + {m^f) } + - hm 



(15) 



P 



(16) 



— j ^ (ttZq m-Q + m'^m'^ + m^m^) + mm 



) + 



1 



d01og2cosh/3/i(0). 



27r/3 

The summation of 6i is now replaced by an integral over 6. The saddle point equations are 
^=gm-h-^rh = 0, (17) 
Of 



dm^ 
df 

df 
drris 

^ = — im 

dm (3 



- Jom(^ - -m(^ = 0, 

-Jokm^ — —rh^ = 0, 

-Jokm^ - —rh^ = 0, 
u s ^ s 



1 r 



i 



df 

df _ 
dm^ (3 

df _ i 
drhs P 



mn 



m'r 



m^ 



2-K 



detanhl3h{e) = 0, 



d^Ce tanh/3/i(^) = 0, 



27r 



cos6'tanh/3/i(6') = 0, 



de^^sin0tanh/3^(0) ) = 0. 



(18) 
(19) 
(20) 
(21) 
(22) 
(23) 
(24) 
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Wc can eliminate m,mQ,m,c ,7nc from Eq. (16) and Eqs. (21)-(24) by using Eqs. (17)-(20). 
We then get 

P 

/ = y E (K)' + + «)')} - f - ^ jyeiog2coshph{e), (25) 

(26) 
(27) 
(28) 
(29) 

^" J-n 

where 

p 

h{e) = Jo E ("^0 + K^c cos 6* + sin 6))^^ - gm + h 

= Jo ^ (m^ + fcm^ cos(0 - (j)!")) ^^-gm + h. (30) 

Next, we calculate the Hessian matrix at the saddle point. From the saddle point equa- 
tions of conjugate variables in Eqs. (21)-(24), we get m, {mg }, {mc }, {m^} as a function of 
m, {m'^},{m^},{m^}: 

m=—[ detanhph{e), (31) 
27r 



m = 


27r. 


/ d0tanh/3/i(^), 

/ — TT 


= 


27r . 


/•TT 

/ d0^^tanh/?/i(^), 

/ — 7r 


= 


2^. 


/"TT 

/ d^Ce cos^tanh^/i(^), 

' — TT 




2^. 


/•TT 

/ d^^^sin0tanh/3/i(^), 



< = ^f d9^^t8inhphi9), (32) 
m^ = -^J d^^^cos^tanh/3/i(e), (33) 

m^ = ^[ d^^^sin^tanh/3/i(^), (34) 
27r J_7r 

where A(^) is given by Eq. (14). Using the inverse functions of Eqs. (31)-(34), we can reduce 
the integrals in Eq. (13): 

/OO f'OC poo f'OO 

■■■ dmdmexp (— /3Af/(m, rh)) — > / ""■ / dmexp (— /3A^/(m, m(m))) , (35) 
-OO J —OO J —OO J —OO 

where m and m are {m, {itIq}, {rric}, {"^s }} and {rh, {rfiQ}, {rhc}, {rrtg }}, respectively. Then, 



6/15 



J. Phys. Soc. Jpn. 

we can consider the Hessian matrix G of the free energy f{m,rri{m)): 



Full Paper 





( df_ 

dm 




'U2 ■ 


■ 




Ui 


Gu 


G12 


Gip 


G = 




G21 


G22 


G2p 






Gpi 


Gp2 ■ 


Gppj 



where 



( ay 

\ dmdm'^ 
( f/ 



G^lv — 



dnicdrnQ 

ay 



ay 

drndnic 

ay 



ay 

drndnis 



ay 

drricdm^ 

ay 

drria dm" 



ay \ 



dmgdrn^ 

ay 

dnic drn^ 

ay 

dmsdm^ 



\dm^dm^ dm^dm^ dm^dm^ / 

Prom Eq. (16) and Eqs. (31)-(34), the Hessian matrix G becomes 



G 



-J 



where 



J 



and 



K = 



•• 

J ■■ 
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, J = 


(jo 





Jok 


\ 
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where 



v.. 



w. 



( dm 
arh^ 



dm^ 
dm 

/ dm^f 

dmc 
dniQ 

1 dm'i 
\drhK 



dm 
drhc 

dmc 
dm 

dm^ 

dmc 
dm^ 

dms 
dmY 



dm 
drhs 



dm^ \ 
dm J 

dm^ \ 

dmc 
dm^ 
dm'i I 
dm" / 



(36) 



(37) 
(38) 



(39) 



(40) 



(41) 



(42) 
(43) 

(44) 



Let us consider the case where only the first stored pattern is retrieved. Since the order 
parameters of subsequent stored patterns ttiq , mc , m^(/i > 2) are zero, and the stored patterns 
are orthogonal to each other, ^v^jW/j, (/x > 2) and K^i, [ji ^ v) become zero. Furthermore, the 
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Kpp). Then, we can reduce 



G 



\0 



where 



G2J 







\ 



\ 


K2'l 



(45) 



K2. 



(46) 



and K2 = Kii = K22 



pp- 



3.2 Mean-Field Equation 

In this section, we introduce the mean-field equation for later use. Since our model has 
infinite range interactions, the mean-field approximation is satisfied exactly within the ther- 
modynamic limit. The mean- field equation is 

(Se,) =tanh/3/i(0,), (47) 

where h{9) is given by Eq. (30). We can actually sec the spin configurations from this equation 
in the following way. First, we calculate the values of the order parameters by solving Eqs. 
(26)-(29), and then substitute these values into the right-hand side of Eq. (47). In this way, 
we will see the spin configurations presented in Section. 4. 

4. Results 

4.-1 Phase Diagram 

In this subsection, we present the results from a bifurcation analysis with (/3, Jq, k) set to 
(10,1,1.5) using Eqs. (26)-(29) and the Hessian matrix Eq. (45). For simplicity we confine 
ourselves to cases where only one or no stored pattern is retrieved. We derive five phases in 
our model. In two of the five phases, the stored patterns are not retrieved, and in the other 
three phases, a stored pattern is retrieved. In one of these three phases, our model achieves a 
discrete and continuous information representation. 

First, we give a detailed account of the two phases where stored patterns are not retrieved. 
In these two phases, the antiferromagnetic interaction g and the external magnetic field h 
govern the spin configuration. We distinguish between these two phases by looking at the sign 
of the magnetization m: the non-retrieval-firing (NRF) phase has a positive magnetization 
m > and the non-retrieval-resting (NRR) phase has a negative magnetization m < 0. In 
the NRF phase, the firing neurons dominate the network, but the resting neurons dominate 
the network in the NRR phase. The NRF and NRR phase boundaries are shown in Fig. 2(b) 
represented as crosses (x) and pluses (-I-), respectively. 
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Fig. 2. Phase diagram in space with fixed parameters {(3,Jo,k) = (10,1,1.5). There are five 

phases, the localized retrieval (LR) phase, non-retrieval-firing (NRF) phase, non-retrieval-resting 
(NRR) phase, global retrieval (GR) phase, and the twisted retrieval (TR) phase, (a) LR phase 
boundaries. The size of the LR phase depends on the number of stored patterns p. If p = 1, the 
region of the LR phase is LRl. On the other hand, if p > 2, the region of the LR phase is LR2. 
The LRl region covers LR2 region. In both cases, the range of h of the LR phase expands when 
g increases. The boundary of the LRl phase and that of the LR2 phase are plotted using white 
squares (□) and black squares (■), respectively, (b)-(d) Positional relationships between LR phase 
and other phases. Crosses (x) are used to plot the boundary of the NRF phase, pluses (-I-) for the 
NRR phase, triangles (A) for the GR phase, and bullets (•) for the TR phase. 



Second, we give a detailed account of the three phases where a stored pattern is retrieved. 
We label these three phases the global retrieval (GR), twisted retrieval (TR), and localized 
retrieval (LR) phases, which is the desired phase where our model achieves a discrete and 
continuous information representation. In the GR phase, a stored pattern is retrieved in the 
entire network and the spin configuration is not modulated by the Mexican-hat type inter- 
action (mQ > 0,mi = 0, mQ = rrii = 0{v fi)) as shown in Fig. 3(a). The GR phase 
is equivalent to the retrieval phase of the Hopfield model, but we use the word "global" 
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Fig. 3. (a) Spin configuration in GR phase. A stored pattern is retrieved in the entire network; (b) 
Spin configuration in TR phase. One half of the spin configuration is ahgned with the stored 
pattern, and tlic otlior lialf is a reverse to the stored pattern; and (c) Spin configuration in LR 
phase. A localized part of a stored pattern is retrieved in one half of the network, and spins are 
resting in the other half. 



to distinguish the GR phase from the other two retrieval phases. Triangles (A) are used to 
represent the GR phase boundary in Fig. 2(c). In the TR phase, half of the spin configura- 
tion is aligned with a stored pattern, and the other half is a reverse of the stored pattern 
(mQ = 0,mi > 0, mQ = rrii = {){v ^ jj,)), as shown in Fig. 3(b). Bullets (•) are used 
to represent the TR phase boundary in Fig. 2(d). In the LR phase, a localized part of a 
stored pattern is retrieved in half of the network, and spins are resting in the other half 
(m < 0, ttZq > 0,771]* > 0, mo = rrii = 0(z/ ^ fj,)), as shown in Fig. 3(c). In the LR phase, 
represents the position of the localized retrieval. In both Fig. 4(a) and Fig. 4(b), a localized 
part of the /xth stored pattern is retrieved, but the positions of the localized retrieval 
are different from each other. = — 7r/4 in Fig. 4(a), and (pi^ = in Fig. 4(b). Thus, the 
LR states are neutrally stable along the positions of the localized retrieval. In Fig. 4(b) and 
in Fig. 4(c), the /xth stored pattern and the i^th stored pattern are locally retrieved around 
the same position, respectively. Thus, our proposed network can store and locally retrieve a 
number of patterns at the same position. The size of the LR phase depends on the number of 
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Fig. 4. Spin configuration in LR phase with fixed parameters Jo, k, g, h) = (10, 1, 1.5, 2, —1.5). (a) 
/uth stored pattern is locally retrieved around location 6 = — 7r/4. (b) /xth stored pattern is locally 
retrieved around location 9 = 0. (c) /i)th stored pattern is locally retrieved around location 
61 = 0. 



stored patterns p. Let us consider the case where the first stored pattern is locally retrieved. 
We can confirm through an eigenvalue analysis that Gi in Eq. (45) has a zero-eigenvalue 
corresponding to the neutral stability of the LR states on a one-dimensional ring (subsection 
4.3). The other eigenvalues of Gi are positive in the entire LRl phase. Therefore, if only one 
pattern is stored in the network {p = 1), the LR states are stable throughout the entire LRl 
phase. On the other hand, G2 in Eq. (45) has a negative eigenvalue in part of the LRl phase, 
that is, the difference between the LRl and LR2 phases. Therefore, if there is more than one 
stored pattern {p > 2), the LR states are stable only in the LR2 phase. Thus, we get the 
phase diagram shown in Fig. 2(a). If p = 1, the LR phase region is LRl. On the other hand, if 
p>2, the LR phase region is LR2. We must note that the LRl region covers the LR2 region. 
In both cases, the range of h of the LR phase expands as g increases. This means that the 
antiferromagnetic interaction g increases the robustness. We dwell on the features of the LR 
state in subsection 4.3. The LR states represent the discrete and continuous information. 

4-2 Role of Antiferromagnetic Interaction and External Magnetic Field 

In this subsection, we confirm the role of the external magnetic field h and the antiferro- 
magnetic interaction g in the LR phase by using a mean-field analysis. h{6i) in the mean-field 
equation (47) represents the local magnetic field applied to the spin located at 9i. We set 
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Fig. 5. Spin configuration with fixed parameters (p.Ja.k.g) = (10.1,1.5,2). (a) Spin configuration 
in GR phase with h = —0.7. (b)-(d) Spin configurations in LR phase, h is set to —1.1, —1.5, 
and —1.9 in (b) to (d), respectively. With a decrease in h, the retrieval is locaUzed to a narrower 
region. 



g > 0, and h < 0. Let us consider the case where the /xth stored pattern is locally retrieved. 
Then we have m < 0, uiq > 0, rrii > 0, and uiq = m\ = Q{v ^ jj). The local magnetic field 
becomes 

h{ei) = Jo (m^ + kml cos{di - (^'^)) -gm + h. (48) 

First, we show the role of the external magnetic field h in the LR phase. We focus on the 
term Jq (mg + kmiCOs{9i — <^'*))^^., which is proportional to the ith component of the /xth 
stored pattern vector This term represents the magnetic field applied in the same direc- 
tion as ^g, weighted by Jq (ttZq + kmiCOs{9i — (f)^))- Therefore, around the location 6i = 
Jo {rriQ + km^ cos{6i — (t>^)) ^q. attempts to strongly align the spin configuration with the /xth 
stored pattern, whereas it weakly attempts this around the location Oi = Consequently, 
in the portion where the condition Jq (mQ + km1cos{9i — cf)'^)) < gm — h \s satisfied, the lo- 
cal magnetic field has a negative value independent of ^q, leading to {Se^) < 0. Therefore, a 
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decrease in h causes an increase in gm — h, localizing a retrieval (Fig. 5(a)-(d)). Thus, the 
external magnetic field h is essential for the LR state to exist. 

Second, we focus on the term gm in Eq. (48), and show the role of g in the LR phase. 
We assume that a small displacement of the magnetization m — > m + Am is caused by 
noise. If we have a positive displacement Am > 0, the term —gm decreases by —gAm to 
—g{m + Am). This means that a positive displacement of m from the equilibrium additively 
generates a negative magnetic field, leading to displacement correction. In the same way, a 
negative displacement of m from the equilibrium additively generates a positive magnetic 
field, leading to displacement correction. Thus, the antiferromagnetic interaction g stabilizes 
the LR states. 



4-3 Information Representation in LR Phase 

In this subsection, we discuss the information representation in the LR phase. Figure 4 
shows three spin configuration instances in the LR phase. 

In Fig. 4(a), the /uth stored pattern is locally retrieved around the location 9 = — 7r/4, 
and in Fig. 4(b), the //th stored pattern around the location 9 = 0. There is a nonzero 
overlap between the spin configuration in Fig. 4(a) and the one in Fig. 4(b), because these 
two spin configurations coincide with each other in — 7r/2 < 9 < 7t/4 region. Consequently, 
the information represented in Fig. 4(a) and that in Fig. 4(b) are associated with each other. 
Therefore, the localized retrievals of an individually stored pattern are distinguished and 
related to each other by the phase values 0'^, that is, the localized retrievals form a "group", 
continuously ordered by the phase values (f)'^. Thus, a continuous information representation 
is achieved in the LR phase as well as in the model with the Mexican-hat type interaction. 

On the other hand, the uth stored pattern is locally retrieved around the location 9 = 
in Fig. 4(c). Therefore, the spin configuration in Fig. 4(b) and that in Fig. 4(c) have an equal 
phase value (0^ = 0'" = 0). Additionally, there is no overlap between the spin configuration in 
Fig. 4(b) and that in Fig. 4(c), because of the orthogonality between and Consequently, 
the information represented in Fig. 4(a) and that in Fig. 4(b) are not associated with each 
other. Therefore, two localized retrievals from two different stored patterns have no overlap 
that is independent of the phase values. Thus, a discrete information representation is achieved 
in the LR phase as well as in the Hopfield model. 

Finally, we will now discuss the behavior of our model in the LR phase from the perspective 
of an attractor network. Let us consider the case where the /uth stored pattern is retrieved 
(m < 0, mg > 0, > 0, and mg = m,'( = 0{u ^ jj)). The free energy is 

/ = y {{<? + - f - ^ r deiog2cosh/3/i(e), (49) 
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where 

h{e) = Jo (m^ + km'^ cos{e - (f)!")) C^-gm + h. (50) 

We find using this equation that the free energy is independent of the phase value cf)'^, that is, 
the LR states are neutrally stable on a one-dimensional ring, which is termed a line attractor. 
Therefore, our model represents continuous information with the LR states. On the other 
hand, because different patterns are orthogonal to each other, the respective line attractors of 
the stored patterns are discretely distributed in the network state space. Thus, our model also 
represents discrete information. As shown above, our model achieves a discrete and continuous 
information representation. 

5. Conclusion 

We have presented the results from our study on an Ising spin neural network that has 
a Hebbian interaction weighted by a Mexican-hat type interaction, an antiferromagnetic in- 
teraction, and an external magnetic field. We obtained five phases, the non-retrieval-firing 
(NRF) phase, the non-retrieval-resting (NRR) phase, the global retrieval (GR) phase, the 
twisted retrieval (TR) phase, and the localized retrieval (LR) phase by performing a statistical- 
mechanical analysis. In the LR phase, a localized part of a stored pattern was retrieved. The 
LR states are neutrally stable on a line attractor, which corresponds to a continuous infor- 
mation representation. In addition, because the stored patterns arc orthogonal to each other, 
the respective line attractors of the stored patterns are discretely distributed in the network 
state space, corresponding to a discrete information representation. Thus, our model achieves 
a discrete and continuous information representation in the LR phase. 

From the phase diagram, we found that the stability of the LR states depends on the num- 
ber of stored patterns, and that not only a Hebbian interaction weighted by a Mexican-hat 
type interaction, but also an antiferromagnetic interaction and a negative external magnetic 
field arc essential to the existence of the LR phase. Additionally, by performing a mean-field 
analysis, we found that the antiferromagnetic interaction and the negative external magnetic 
field stabilize the LR state. Therefore, the antiferromagnetic interaction and the negative 
external magnetic field are essential for achieving a discrete and continuous information rep- 
resentation. 
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